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Abstract 

We shall consider a stochastic maximum principle of optimal control for 
a control problem associated with a stochastic partial differential equations 
of the following type: 

! ( dx{t) = {A{t)x{t) + a(t, u{t))x{t) + b{t, u{t)))dt 

Oh; } +[{ait,u{t)),xit))^ + g{t,umdM{t), 

I x(0)=XoGK, 

with some given predictable mappings a, b, a, g and a continuous martin- 
gale M taking its values in a Hilbert space K, while u{-) represents a con- 
trol. The equation is also driven by a random unbounded linear operator 
A{t,w), t G [0,r], on K. 
. We shall derive necessary conditions of optimality for this control prob- 

lem without a convexity assumption on the control domain, where u{-) lives, 
Tij- I and also when this control variable is allowed to enter in the martingale 

fS| ■ part of the equation. 

o: 

(N . MSG 2010: 60H15, 93E20, 35B50, 60G44. 

Keywords: Martingale, stochastic partial differential equation, optimal con- 
^ I trol, stochastic maximum principle, adjoint equation, backward stochastic partial 

■ differential equation. 



1 Introduction 

Consider the following stochastic partial differential equation (SPDE for short): 

{dx{t) = {A{t)x{t) + a{t, u{t))x{t) + b{t, u{t)))dt 
+ [{a{t,u{t)),x{t))^ + g{t,u{t))]dM{t), 0<t<T, (1.1) 
a;(0) =xoeK, 

"* This work is supported by the Science College Research Center at Qassim University, 
project no. SR-D-01 1-724. 
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where A{t),t G [0,T], is a random unbounded closed linear operator on a sepa- 
rable Hilbert space K. The noise is modelled by a continuous martingale M in 
K and a, b, a and g are suitable predictable bounded mappings while u{-) is a 
control. This equation will be studied over a Gelfand triple {V,K,V'). That is 
is a separable Hilbert space embedded continuously and densely in K. More 
precisely, given a bounded measurable mapping i : [0,T] x O ^ K and a fixed 
element G of i^, we shall be interested here in minimizing the cost functional: 

Jo 

over the set of admissible controls. We will approach this by using the adjoint 
equation of the SPDE (11.11) . which is a backward stochastic partial differential 
equation (BSPDE) driven by an infinite dimensional martingale, and derive in 
particular a stochastic maximum principle for this optimal control problem. Such 
BSPDEs (or even BSDEs) have their importance shown in applications in control 
theory like |5] and in some financial applications as in [20]. For more applications 
we refer the reader to Bally et al. Imkeller et al. [16] and [T2] . 

It is known that a Wiener filtration is usually required to deal with BSPDEs 
that arise as adjoint equations of controlled SPDEs. This is indeed a restriction 
insisted on for example in [30] and [31]. 0ksendal et al. in [23] and some other 
recent works have now considered the adjoint equation of a controlled BSPDE 
with a filtration generated by a Wiener process and a Poisson random measure. 
In our work here we can consider an arbitrary continuous filtration thanks to a 
result established in [3] giving existence and uniqueness of solutions to BSPDEs 
driven by martingales. In this respect we refer the reader also to Imkeller et al. 
[16] . where a filtration is being taken which is similar to the one used here. The 
reader can also see [5], [29], [H], [H], [15], [18], [13], [27] and [25] for SDEs and 
SPDEs with martingale noises. In fact in [5] we derived necessary conditions for 
optimality of stochastic systems similar to (II. ip . but the result there describes the 
maximum principle only in a local form and requires moreover the convexity of 
the control domain U. In the present work we shall derive the maximum principle 
in its global form for our optimal control problem and, in particular, we shall not 
require the convexity of U. Moreover, our results here generalize those in [31] and 
[To] and can be applied to the optimal control problem of partial observations with 
a given general nonlinear cost functional as done particularly in [HI Section 6]. 
The idea of reducing such a control problem to a control problem for a linear 
SPDE (Zakai's equation) was discussed also there. This is similar to (11.11) . 
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The main new features here are the driving noise is allowed to be an infinite 
dimensional martingale (as in Tudor [29] and Al-Hussein the control domain 
U need not be convex, and the control variable itself is allowed to enter in the 
martingale part of the equation as in the SPDE (11. ip . 

The present paper is organized as follows. In Section [2] we introduce some 
definitions and notation that will be used throughout the paper. In Section [3] 
our main stochastic control problem is introduced. Section H] is devoted to the 
adjoint equation of the SPDE (II. ip as well as the existence and uniqueness of its 
solution. Finally, we state and establish the proof of our main result in Section [5l 

2 Basic definitions and Notation 

We assume that (i7, J-", {J-t}t>o, P) is our complete filtered probability space, 
such that {J^t}t>o is a continuous filtration, in the sense that every square in- 
tegrable ii'-valued martingale with respect to {J-'t , < t < T} has a contin- 
uous version. Let V denote the predictable a -algebra of subsets of x [0,T]. 
A i^- valued process is said to be predictable if it is V/B{K) measurable. Let 
A4^^^j,-^{K) be the space of all square integrable continuous martingales in K. We 
say that two elements M and N of Ai'^Q'^j,^{K) are very strongly orthogonal (VSO) 
if E [M(r) ® N{t)] = E [M(0) ® A^(0)],' for all [0, T] - valued stopping times r. 

For M G A^^p'ipj(i^r) let << M » be its angle process taking its values in the 
space Li{K), where Li{K) is the space of nuclear operators on K, and satisfying 
M (g) M- « M »e M'^^qj,^{Li{K)), and denote by < M > the quadratic vari- 
ation of M. It is known (see [22]) that there exist a predictable process Qm{s,u) 
in Li{K) such that << M »t = Qm{s,uj) d< M >s . 

For (t,u) if Q(t,u) is any symmetric, positive definite nuclear operator on 
K, we shall denote by Lq(j_^s^{K) the set of all linear (not necessarily bounded) 
operators $ which map Q}/^{t,uj){K) into K such that ^Q}l^{t,uj) e L2{K), the 
space of all Hilbert-Schmidt operators from K into itself. The inner product and 
norm in L2{K) will be denoted respectively by (■, -^^ and || ■ ||2- 

We recall that the stochastic integral ^{s)dM{s) is defined for mappings $ 
such that for each {t,u), ^{t,ijj) G Lq^^(^^ ^^{K), for every h E K the i^'- valued 

process ^Q}Ji^{h) is predictable, and E [/q^ ||($Qlf )(t)||2 d < M >t] < oo. 

The space of such integrands is a Hilbert space with respect to the scalar 
product ($i,$2) ^ E [Jq {^iQ]^i^ ,*&2Qm^) d < M >t]. Simple processes in 
L{K) are examples of such integrands. Hence the closure of the set of simple 
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processes in this Hilbert space is itself a Hilbert subspace. We denote it as in (22] 
by A'^{K; V, M). More details and proofs can be found in [21] or |22j . 

In this paper we shall assume that there exists a measurable map- 
ping Q(-) : [0,T] X f2 — )■ Li{K) such that Q(t) is symmetric, positive definite, 
« M »t = /o Q(s) ds, and Q{t) < Q for some positive definite nuclear oper- 



ator Q on K. Thus QM{t) = and < M >t 
Thus, if $ e A^{K;V,M), 



/Jg(s)c?s, with =tr(Q(t)). 



E 



<^{s)dM{s) 







= E 


I- ^0 



\Us 



This equality will be used frequently in the proofs given in Section [5l The process 
Q(-) will play an essential role in deriving the adjoint equation of the SPDE (11 .ip . 
as appearing in the equation (14. ip in Section HI see in particular the discussion 
following equation (14. 4p . 



3 Statement of the control problem 

Let us consider the following space: 

L^(0, T; E) := {ip : [0,T] x Q ^ E, predictable and E [ [ \ij{t)\^dt ] < oo }, 

Jo 

where £^ is a separable Hilbert space. Suppose that (9 is a separable Hilbert space 
with an inner product (■, ■)^, and U is a nonempty subset of O. Denote by 

Had = M-) ■.[0,T]xn^ Os.t.ui-) e L^(0,T; O)}. 

This set is called the set of admissible controls and its elements are called admis- 
sible controls. 

Now let us recall our SPDE: 

dx{t) = iA{t)x{t) + a{t, u{t))x{t) + b{t, u{t)))dt 

+ [{ait, uit)), xit))^ + git, uit))]dMit), (3.1) 

x(0) =Xo e K, 
and impose on it the following assumptions: 

(i) Ait,ijj) is a linear operator on K, "P- measurable, belongs to LiV]V') uni- 
formly in [t, u) and satisfies the following two conditions. 
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• (1) A{t,u) satisfies the coercivity condition: 

2{A{t,u)y,y)+ a\y\l<X\y\^ a.e.te[0,T], a.s.\/yeV, 
for some a, A > 0. 

• (2) 3 A;i > such that for all {t, u) 

\A{t,u)y\^, < h\yl, \fyeV. 

(ii) a : n X [0,T] X O ^ R , b : n X [0,T] X O ^ K, a : n X [0,T] X O ^ K 
and g : Q X [0,T] X O ^ Lq{K) are predictable and bounded given mappings. 

Definition 3.1 We say that x = a;"^-) G L%{0,T;V) is a solution of / TO]) if 

\I 7] eV (or any dense subset) and for almost all {t,u) G [0,T] x Q 

{xi't)^v)K = {^o,v)k+ {A{s)x{s) + a{s,u{s))x{s) + b{s,u{s)) ,r])^ds 

Jo 

+ / {r],[{a{s,u{s)),x{s))^+ gis,uis))]dM{s))^. 
Jo 

Given a bounded measurable mapping i : [0,T] x O ^ K and a fixed element 
G of K, we define the cost functional by: 

J(m(-)) :=E [ r(£(t,M(t)),x"(-)(t))^rft + (G,x<)(T))^], u{-)eUad. (3.2) 
Jo 

It is easy to realize that under assumptions (i) and (ii) there exists a unique 
solution to (13. ip in L'^{0,T] K). This fact can be found in [131 Theorem 4.1, P. 
105], [IHl Theorem 2.10] or [31, Theorem 3.2], and also can be gleaned from |27] . 
Ito's formula for such SPDEs can be found in [HI Theorems 1, 2]. 

Our control problem is to minimize (13. 2 p over Uad- Any «*(■) G Uad satisfying 

J{u*{-)) = inf{J(M(-)) : u{-) G (3.3) 

is called an optimal control. The corresponding solution x"^*^'^ of (13. ip . which we 
denote briefly by x* and {x* ,u*{-)) are called respectively an optimal solution 
and an optimal pair of the stochastic optimal control problem (I3.ip -( l3l3|) . 

The existence problem of optimal control can be developed from the works of 
[1], [2] and [29]. However, a special case can be found in [1]. 



6 



AbdulRahman Al-Hussein 



4 Adjoint equation 

Recall the SPDE (13. ip and the mappings in f l3.2p . and define the Hamiltonian 
H : [Q,T] X n X K X O X K X L2{K) M for {t,uj,x,v,y, z) e [0,T] x Q x K x 
Ox K X L2{K) by 

H{t,u,x,v,y,z) := -{(i{t,v) ,x)y - a{t,uj,v){x ,y) ^ 

- {hit, u, v) , y)^ - {a{t, u, X, v) Q'/\t, u) , z)^ , (4.1) 

where d : [0,T] x Q x K x O ^ Lq{K) is defined by 

a{t, u, X, v) = {a{t, v) , x) ^ <l>(x) + g{t, u, v) 

with $ being the constant mapping ^ : K Lq{K),x $(x) = idx- Then 

{5{t, u, X, v) Q^/\t, u) ,z)^ = { {a{t, u, v),x)^ {^x) + g{t, u, v))Q'/\t, u) , z)^ 
= { {Q}'\t, u) , z)^ a{t, u, v),x)^ + {g{t, u, v) Q}/\t, u) , z)^ 
= {Bit, u, v)z, x)j^ + {git, u, v) Q}'\t, u) , z)^ , 

where B : [{],T] x x O ^ L{L2{K), K) is defined such that 

Bit, CO, v)z = {Q'/\t, u) , z)^ ait, co, v). (4.2) 

Moreover, 

V xHit, oj, X, V, y, z) = —lit, v) — ait, u, v)y — Bit, u, v)z. (4.3) 
The adjoint equation of (13.11) is the following BSPDE: 



dy<-\t) = - A*it)yit) - V.Hit,x<-\t),uit),y<\t),z<-\t)Q}'\t)) 



dt 



y<\T) = G, 



it) dMit) + dA^"(-) it), 0<t<T, (4-4) 



where A* it) is the adjoint operator of Ait). 

It is important to realize that the presence of the process Q^/^(-) in the equa- 
tion (14.41) is crucial in order for the mapping VxH to be defined on the space 
L2iK), since the process z"^^'^ need not be bounded as it is discussed in Section [2l 
This has to be taken always into account when dealing with BSPDEs and even 
BSDEs in infinite dimensions; cf. also [6J. 
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The following theorem gives the solution to this BSPDE (14 .4^ in the sense that 
there exists a triple {y''^-^ z<\ N<^) in L^O,T-K) x A\K;V,M) x M^^Q^^^^iK) 
such that the following equality holds a.s. for all t G [0,r], A^(0) = and is 
VSO to M: 

T pT 

z''^-\s)dM{s)- dN<-\s). 



Theorem 4.1 Assume that (i)-(ii) hold. Then there exists a unique solution 
{y<\z<\N<y) of the BSDE ^ m L^O,T;K) x A'^{K;V,M) x M^^^'',j.^{K) . 

The proof of this theorem can be found in [3]. 

We shall denote briefly the solution of ( I4.4p corresponding to the optimal 
control «*(■) by {y*,z*,N*). 

5 Main results 

In this section we shall derive and prove our main result on the maximum prin- 
ciple for optimal control of the SPDE (13.11) associated with cost functional (I3.2p 
and value function (13.31) by using the results of the previous section on the adjoint 
equation (BSPDE). Before doing so, let us mention that the relationship between 
BSPDEs and maximum principle for some SPDEs is developed in several works, 
among them for instance are [24j and [30] and the references of Zhou cited therein. 
Other discussions in this respect can be found in [2H] and [31] as well. Bensous- 
san in [11] Chapter 8] presents a stochastic maximum principle approach to the 
problem of stochastic control with partial information treating a general infinite 
dimensional setting and the adjoint equation is derived also there. Another work 
on the maximum principle that is connected to BSDEs can be found also in [7]. 
For an expanded discussion on the history of maximum principle we refer the 
reader to [30l P. 153-156]. And finally, one can find also useful information in 
Bensoussan's lecture notes |9], |9] and Li & Yong [19] in addition to the references 
therein. 
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Our main theorem is the following. 

Theorem 5.1 Suppose (i)-(ii). If{x*,u*{-)) is an optimal pair for the problem 
lis. ip -z TOj) . then there exists a unique solution {y*,z*,N*) to the corresponding 
BSEE (^T^ such that the following inequality holds: 



H{t,x*it),u,y*{t),z*{t)Q'/\t)) 

< H{t,x*{t)Xit),y*{t),z*{t)Q}'\t)) (5.1) 

a.e. t e [0,T], a.s. Vm G U. 

To start proving the theorem we need to develop some necessary estimates 
using the so-called spike variation method. For this we let (x*,u*(-)) be the 
given optimal pair. Let < to < 7" be fixed such that E [|x(to)||'] < and 
< £ < T — to- Let n be a random variable taking its values in f/, J^t^ - measurable 
and sup |^^(c(;)| < oo. Consider the following spike variation of the control «*(■): 



Ueit) 



u*it) a te[0,T]\[to,to + e] 
u if t e [to, to + 



We can consider the x'^^^ -' as the solution of the SPDE (13. ip corresponding to 
Ue{-). We shall denote it briefly by x^. Note that Xeit) = x*{t) for all < t < to. 

We shall divide the proof into several lemmas as follows. 

Lemma 5.2 Suppose (i)-(ii). Then 

sup E[|x,(t)|^] <Ci(E[|x*(to)|^ + C2£) (5.2) 

for some positive constants Ci and C2. 

Proof. Observe flrst from (13. ip and (15.20 that, for to < t < to + e, 

^^(t) = a;*(to) + / [A{s)xs{s) + a{s,u)xe{s) + b{s,u))ds 

J to 

+ [ [{a{s,u),Xeis))^+ gis,u)]dM{s). (5.3) 

J to 



Maximum principle for optimal control of stochastic partial differential equations 9 

Therefore, by Ito's formula, assumption (i), Cauchy-Schwartz inequality and as- 
sumption (ii) we get 

E[\x,{t)\l]+aE[ [ \x,{s)\lds]<E[\x*{to)\l] + XE[ [ \x,{s)\lds] 



+ 2E[ {a{s, u) x^{s) ,Xs{s))j^ds] + 2E[ {x^{s) ,b{s,u)) ^^ds] 

J to J to 

+ 2E[ t\\ {a{s, u) , x,(.)>^ idx Q^'^s) \\lds] + 2E\f \ \ g{s, u) Q''\s) \\lds ] 

J to J to 



' to J to 

'to J to 



Xeis) Ixds] 



< E[\x*{to)\l] + XE[ [ \xe{s)\lds]+2kiE[ [ 

J to J to 

+ klE[ [ \Xe{s)\lds] + it-to) 
J to 

+ 2kl 1 1 1 1^ E [ r I xe{s) \l ds ] + 2kle \ \ Q^'W 

J to 

= {X + 2k, + kl + 2kl\\Q'/Y2ii + e)) fE[\xM\l]ds 

J to 

+ (1 + 2^:4^4^ 1 1 Q'^'Wl) ^ + E [ I x*{to) (5.4) 

In the last part of this inequality we have used the boundedness in assumption 
(ii) of the mappings a, b, a, g respectively to get the constants ki — k^. 

Thus, in particular, by applying Gronwall's inequality to (15 ■4p we obtain (I5.2p 
with 

Ci = (^+2fci+fci+2feill2''"lli(i+e))) 

and 

C2 = l + 2kl\\Q'/Y2- 

This completes the proof. ■ 

Lemma 5.3 Suppose (i)-(ii). Then 

sup E[\xe{t)\l]<C:,{E[\x*{t,)\l] + C,e + l) (5.5) 

to+£<t<T 

for some positive constants C3 and C4. 
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Proof. For to + e <t <T, it follows that 

Xs{t) = x*{to + e) + I [A{s)xe{s) + a{s,u*{s))xe{s) + b{s,u*{s)))ds 



+ [{a{s,u*{s)),x,{s))^+ g{s,u*{s))]dM{s). (5.6) 



to+e 



Thus mimicking the proof of Lemma 15.21 and then applying inequality (15. 2p 
easily yields (15. 5p . ■ 



Lemma 5.4 Suppose (i)-(ii). Let ^^if) = x^it) —x*(t), fort G [0,T]. Then 



sup E[\Ut)\l] = 0i6). 

to+e<t<T 



(5.7) 



Proof. It is easy to get for t E [t^ + e, T], 

Jta+e 



+ 



to+e 



[a{s,u*{s)),Us))KdM{s) 



(5. 



Hence, as done in the proof of Lemma [5.21 we get 



sup E[\Ut)\l]<C,E[\Uto + e)\l' 

to+e<t<T 



On the other hand, for to < t < to + e we have (.eito) = and 

m = 



(5.9) 



to 



A{s)^e{s) + {a{s, u) - a{s, u*{s))) Xe{s) 

+ (6(s, u) - 6(s, u*{s))) + a(s, u*{s)) Us) 



ds 



+ 



to 



,u*{s)) ,Xe{s)) 



K 



+ {g{s,u)-g{s,u*{s))) + {a{s,u\s)),Us))K dMi-s). (5.10) 
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Hence by Ito's formula, assumption (i), Cauchy-Schwartz inequality and assump- 
tion (ii) it follows that 

^[\Ut)\%]+aE[ f\Us)\lds] 

J to 

< XE[ f \Us)\Kds]+ 2E[ f {Us),{a{s,u)-a{s,u*{s)))xe{s))^ds] 

J to J to 

+ 2E[ [ {Us)Ms,u)-b{s,u*{s)))^ds] 

J to 
Jto 

+ 3E[ / \\ {cr{s,u) ~ ais,u*{s)) ,x,{s))^idK Q'/''is)\\lds] 

Jto 

+ 3E[ / \\{ais,u*is)),Us))j,idKQ'^'is)\\lds] 

Jto 

+3E[ f\\{gis,u)-g{s,u*is))) Q'^\s) \\lds] 

Jto 

< {\ + Akl + kl + 2h + 3kl-\\Q'/Y2) [ ^{\Us)\l]ds 

Jto 

rto+£ 

+ {6kl\\Q'/Y2 + ^) / E[\xe{s)\l]ds + {l + 12kl)e 

Jto 

< (X + 4kl + kl + 2k^ + 3kl\\Q'/'\\l) tE[\Us)\'K]ds 

Jto 

+ (Qkl 1 1 Q'^Y2 + 1) Ci ■ (E [I x*{to)\l] +C2e)e + {1 + 12kl)e. (5.11) 
Therefore Gronwall's inequality gives 

sup E[\Ut)\l]<Ce{e)-e, (5.12) 

to<to+s 

where 

C,{e) = e(^+4fc?+/ci+2fc,+3fci||SV2||2), _ r^g^2 ||gl/2||2 + 1) . (E [ | X* (to) | ] 

+ C2e) + l + 12kl . 

Now by applying (15.121) in 05.91) it yields eventually 

sup E[\Ut)\l]<C,Ceis)-e. (5.13) 

to+e<t<T 



12 



AhdulRahman Al-Hussein 



Thus (ETD follows. ■ 

In the following result we shall try to compute K[(^y*(to + e),C,(to + e)') ^]. 
Lemma 5.5 Suppose (i)-(ii). We have 



E 



'to 



to+e 



= E[ {y*{t) , {a{t, u) - a{t, u*{t))) x,it))^ ] 

J to 

+ E[ /° {y*{t),b{t,u)-b{t,u*{t)))^.dt] 

J to 

rto+e 

+ E [ / {ait, u) - ait, u\t)) , x,{t))^ {Q}l\t) , Q}'\t))^ dt ] 



'to 

rto+e 

+ E[ / {{g{t,u) - g{tX{t)))Q'/'{t) ,z*{t)Q'/'{t))^dt] (5.14) 

-'to 



and 



E[{y*ito + e),Uto + e))^]=E[ f {l{tX{t)) ,Ut)) k^A 

J to+e 

+ E[{G,UT))j,]. (5.15) 

Proof. Note that ioi t^ < t < t^ + e we have ^^(to) = and (15.101) . Therefore 
by using Ito's formula to (15.101) together with (14.41) . (14. 3 p and (14. 2 p we get easily 
(I5.14p . The equality in (I5.15P is proved similarly with the help of (15. 8p . ■ 



Lemma 5.6 Suppose (i)-(ii). We have 
< E 



{lit,u) - lit,u*it)) ,x*it))^dt] 



K 

to 
to+e 



+ E[ {y*{t) , {a{t, u) - a{t, u*{t))) x*{t))^ ] 

J to 

+ E [ {ait, u) - ait, u\t)) , x\t)) ^ {Q^/\t) , z*it)Q'/\t))^ dt] 

J to 
rto+e 

+ E[ / {y*it),bit,u)-bit,u*it)))^dt] 

J to 

+ E[ r^\{git,u)-git,u\t))Q^/\t),z\t)Q''\t))^dt]+oie). (5.16) 

J to 
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Proof. Since u*{-) is optimal, we have 



< JM)) - J{u*{-)) 

= ^[j {{i{t,u,{t)),x,{t))^-{i{t,u*{t)),x*{t))j^)dt] 
+ E[{G,x,{T))^-{G,x*{T))^] 



E 



to 



{{iit, u) - iit, u*{t)) , x,(t)>^ + u*it)) , Ut))j,) dt 

Jtn+e 



Hence using Lemma 15.51 (15.151) in this inequahty gives 



< E 



to+e 



to 



U) - u*it)) , Xeit))^dt + {£it, u*it)) , Ut))^) dt 

+ E[{y*{to + e)),Uto + e))^]. (5.17) 



Again by Lemma 15.51 (I5.14p inequahty (15.171) becomes 



rto+e 

0<E[ {£{t,u)-iit,u*it)),x,{t))^dt] 

Jto 

rto+s 

+ E[ / {y*{t),{a{t,u)-a{t,u*{t)))xe{t))^dt] 
Jto 

+ E[ /" {y*{t),b{t,u)-b{t,u*{t)))j^dt] 

Jto 

+ E [ {a{t, u) - a{t, u*{t)) , x,(t))^ {Q'/\t) , z*{t)Q'/\t))^ dt] 

Jto 

+ E [ ( {g{t, u) - git, u*{t))) Q'/\t) , z*{t) Q^'\t))^ dt ] . (5.18 
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On the other hand, assumption (ii) and Lemma 15.41 imply 

-E[ {y*it),{ait,u)-ait,u*it)))Ut))Kdt] 

"to+e 



< Cri-) /" \(\y*{t)\K-\Ut)\K)dt 

< Cs[e'/Hl) n\y*it)\l]dt + {-^)e{^^)e)^0, (5.19) 



as e — )■ 0, provided that to is a Lebesgue point of the function t K[\y*(t) W 
for some positive constants C^ and C^- 
Similarly, 



{{l{t,u)-l{tXit)),Ut))K 
to ^ 



+ {a{t, u) - a{t, u*{t)) , Ut))^ { Q"\t) , z\t) Q}'\t))\ dt ^ 0, (5.20) 



1e 

£ 



as £ — > 0, provided that to is a Lebesgue point of the function 

Therefore, by applying fl5.19p and fl5.20p in f l5.18p we obtain fl5.16p . ■ 

We are now ready to complete the proof of Theorem 15. 1[ 
Proof of Theorem 15.11 Divide fl5.16p in Lemma 15.61 by e and let e — to get 

E [ (£(to, u) - £(to, M*(to)) , x*(to)>^ + (y*(to) , (a(to, u) - a(to, n*(to))) a;*(to)>^ ] 
+ E [ (|/*(to) , Ki^o, w) - K^o, w*(to))>^ ] 

+ E [ (a(to, u) - a{to, n*(to)) , x*{to)) ^ {Q'/\to) , z*{to)Q'/\to))^ ] 
+ E[{ {g{to, u) - g{to, n*(to)) Q'^^to) , z*(to) Q^/'(to)>2 ] > 0. 

Consequently, 

H{to,x*{to),u,y*{to),z*{to)Q'/\to)) 

< H{to,x*{to),u*{to),y*{to),z*{to)Q'/\to)). 

Hence (15. ip holds by a standard argument as for example in [301 Chapet 3], and 
the proof of Theorem 15.11 is then complete. 
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